add Popular search engines' spiders user-agent list#56
add Popular search engines' spiders user-agent list#56bpceee wants to merge 3 commits intoprerender:masterfrom
Conversation
|
Can anyone have a look at this PR? |
|
Sorry for the delay! Adding .woff and .tff is good, but your Also, the user agent example you added contains Googlebot, which doing a user agent check on Googlebot will get you penalized for cloaking. You should only check for user agents that do not support the escaped fragment protocol. |
|
@thoop |
|
@bpceee, want to pull the .woff and .ttf changes into a separate PR, or remove the other pieces from this PR? |
|
@homeyer, better remove the other pieces from this PR, but how to do it? |
|
|
|
Went ahead and opened a new PR (#74), I'll merge tonight after the tests pass. |
add Popular search engines' spiders user-agent list